CENTRAL LIMIT THEOREM FOR NONLINEAR HAWKES 

PROCESSES 



LINGJIONG ZHU 



Abstract. Hawkes process is a self-exciting point process with clustering ef- 
fect whose intensity depends on its entire past history. It has wide applica- 
tions in neuroscience, finance and many other fields. In this paper, we obtain a 
functional central limit theorem for nonlinear Hawkes process. Under the same 
assumptions, we also obtain a Strassen's invariance principle, i.e. a functional 
law of the iterated logarithm. 



1. Introduction and Main Results 

1.1. Introduction. Hawkes process is a self-exciting simple point process first in- 
troduced by Hawkes [5]. The future evolution of a self-exciting point process is 
influenced by the timing of past events. The process is non-Markovian except for 
some very special cases. In other words, Hawkes process depends on the entire 
past history and has a long memory. Hawkes process has wide applications in neu- 
roscience, seismology, DNA modeling, finance and many other fields. It has both 
self-exciting and clustering properties, which is very appealing to some financial 
applications. According to Errais et al. [S], "The collapse of Lehman Brothers 
brought the financial system to the brink of a breakdown. The dramatic repercus- 
sions point to the exisence of feedback phenomena that are channeled through the 
complex web of informational and contractual relationships in the economy... This 
and related episodes motivate the design of models of correlated default timing that 
incorporate the feedback phenomena that plague credit markets." The self-exciting 
and clustering properties of Hawkes process make it a viable candidate in modeling 
the correlated defaults and evaluating the credit derivatives in finance, for example, 
see Errais et al. [8] and Dassios and Zhao [6]. 

Most literatures of Hawkes process study only the linear case, which has an 
immigration-birth representation (see Hawkes and Oakes |10|). The stability, law 
of large numbers, central limit theorem, large deviations, Bartlett spectrum etc. 
have all been studied and understood very well. Almost all of the applications of 
Hawkes process in the literatures consider exclusively the linear case. Because of the 
lack of immigration-birth representation and computational tractability, nonlinear 
Hawkes process is much less studied. However, some efforts have already been made 
in this direction. For instance, see Bremaud and Massoulie [3J, Zhu [H] and Zhu 
[15] . In this paper, we will prove a functional central limit theorem for nonlinear 
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Hawkes process. Hopefully, in the future, nonlinear Hawkes processes will also be 
used in the applications in various fields. 

For a list of references on the theories and applications of Hawkes process, we 
refer to Daley and Vere- Jones [5] and Liniger [T3] . 

1.2. Nonlinear Hawkes Processes. Let N be a simple point process on R and 
let Ti°° :— a(N(C), C € B(M),C C (— oo, t}) be an increasing family of cr-algebras. 
Any nonnegative J 7 ^ 00 -progressively measurable process At with 



(1.1) E[N(a,b]\F-°°]=E 



b 

\sds\T-°° 



a.s. for all intervals (a, b] is called an °° -intensity of N. We use the notation 
N t := N(0, t] to denote the number of points in the interval (0, t]. 

A general Hawkes process is a simple point process N admitting an 
intensity 

(1.2) \ t ~\(J h{t-s)N{ds) 

where A(-) : R + — > R + is locally integrable, left continuous, h(-) : R + K + and we 
always assume that \\h\\ L i = h{t)dt < oo. In (|1.2p . J_ h(t — s)N(ds) stands 
for fr^ t s h(t — s)N(ds) = Y^ T <t ^(^ — T )' wn ere r are the occurences of the points 
before time t. 

In the literatures, h{-) and A(-) are usually referred to as exciting function and 
rate function respectively. 

A Hawkes process is linear if A(-) is linear and it is nonlinear otherwise. 

Bremaud and Massoulie [5] proved that under the assumption that A(-) is a- 
Lipschitz with < 1, there exists a unique stationary and ergodic version of 

Hawkes process satisfying the dynamics fj 1 . 2[) . 

Bremaud and Massoulie [3] studied the stability of nonlinear Hawkes process 
in great details, including existence, uniqueness, stability in distribution and in 
variation etc. 

Later, Bremaud et al. [4] studied the rate of convergence of nonlinar Hawkes 
process to its stationary version. 

1.3. Limit Theorems for Hawkes Processes. When A( ) is linear, say X(z) = 
v + z, for some v > and H/iHl 1 < 1, Hawkes process has a very nice immigration- 
birth representation, see for example Hawkes and Oakes [10]. For linear Hawkes 
process, limit theorems are very well understood. There is the law of large numbers 
(see for instance Daley and Vere- Jones [5]), i.e. 

/ \ N t v 

(1.3) > ——. — , as t — > oo a.s. 

t l-\\h\\ L i 

Moreover, Bordenave and Torrisi [5] proved a large deviation principle for (-r 4 - € •) 
with the rate function 



(1.4) I{x) = 



a; log ( ^pjpjj— - ) — x + x\\h\\i,i + v if.TG[0,oo) 



otherwise 
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Recently, Bacry et al. |T] proved a functional central limit theorem for linear 
multivariate Hawkes process under certain assumptions. That includes the linear 
Hawkes process as a special case and they proved that 

(1.5) — -jJ^- -> ctB(-), as t -> oo, 

V* 

where £?(•) is a standard Brownian motion. The convergence is weak convergence on 
D[0, 1], the space of cadlag functions on [0, 1], equipped with Skorokhod topology. 
Here, 

(1-6) U = tttti — and a 2 = — — — r-=-. 

Very recently, Karabash and Zhu [T2] obtained central limit theorem and large de- 
viation principle for linear Hawkes process with random marks. In a nutshell, linear 
Hawkes process satisfies very nice limit theroems and the limits can be computed 
more or less explicitly. 

On the contrary, when A(-) is nonlinear, the usual immigration-birth representa- 
tion no longer works and you may have to use some abstract theory to obtain limit 
theorems. Some progress has already been made for nonlinear Hawkes process. 

Bremaud and Massoulie [3 's stability result implies that by the erogdic theorem, 

Nt 

(1.7) -^->/*:=E[i\T[0,l]], 

as t —> oo, where E[JV[0, 1]] is the mean of N[0, 1] under the stationary and ergodic 
measure. 

When h(-) is exponential (and A(-) is nonlinear), the Hawkes process is Markovian 
and Zhu [H] obtained a large deviation principle for (N t /t G •) in this case. Zhu 
[14] also proved the large deviation principle for the case when h(-) is a sum of 
exponentials and used that as an approximation to recover the result for the linear 
case proved in Bordenave and Torrisi [2]. 

For the most general h(-) and A(-), Zhu [T3] proved a process-level, i.e. level-3 
large deviation principle for the Hawkes process and used contraction principle to 
obtain a large deviation principle for (Nt/t € •)• 

In this paper, we will prove a functional central limit theorem and a functional 
law of the iterated logarithm for nonlinear Hawkes process. 

1.4. Main Results. The following is the assumption we will use throughout this 
paper. 

Assumption 1. We assume that 

• h(-) : [0, oo ) — > R + is a decreasing function and J Q °° th(t)dt < oo. 

• A(-) is positive and increasing and a-Lipschitz (i.e. \\(x)—X(y)\ < a|a; — y\ 
for any x,y) such that < 1. 

Bremaud and Massoulie [3] proved that if A(-) is a-Lipschitz with a||/i|| £ i < 1, 
there exists a unique stationary and ergodic Hawkes process satisfying the dynamics 
(jl.2[) . Hence, under our Assumption Q] (which is slightly stronger than [3]), there 
exists a unique stationary and ergodic Hawkes process satisfying the dynamics (jl.2l) . 

Let F and E denote the probability measure and expectation for stationary and 
ergodic Hawkes process and P(-|J r ^~ 00 ) and E(-|J r _o °) denote the conditional prob- 
ability measure and conditional expectation for the Hawkes process given the past 
history. 
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The following are the main results of this paper. 

Theorem 1. Under Assumption^ let N be the stationary and ergodic nonlinear 
Hawkes process with dynamics (|1.2p . We have 

N.t — -nt „, , 

(1.8) P -> trB(-), as i^oo, 

where B(-) is a standard Brownian motion and < c < oo, where 

oo 

(1.9) a 2 := E[(JV[0, 1] - m) 2 ] + 2 £ E[(JV[0, 1] - fi)(N\j, j + 1] - 

i=i 

TTie convergence in (|1.8[) is weafc convergence on D[0, 1], i/ie space of cddldg func- 
tions on [0, 1], equipped with Skorokhod topology. 

Remark 1. By a standard central limit theorem for martingales, i.e. Theoerem^ 
it is easy to see that 

N. t - f n * X s ds 

(1.10) — — J -j^ > VM-B(-), as t->oo, 

Vi 

where /i = E[iV[0,l]]. In the linear case, say X(z) = v + z, Bacry et al. pQ 
proved that a 2 in p.9[) satisfies a 2 = > f- = i- \\ h \\ I • That is not 

surprising because N.t — -fit "should" have more fluctuations than N.t — L \ s ds. 
Therefore, we guess that for nonlinear A(-), a 2 defined in (|1.9j) should also satisfy 
a 2 > pi = E[iV[0, 1]]. However, it might not be very easy to compute and say 
something about a 2 when A(-) is nonlinear. 

In the classical case for a sequence of i.i.d. random variables Xi with mean and 
variance 1, we have the central limit theorem Ylj—i Xi — > N(0, 1) as n oo, and 

we also have . * =1 , ' — > in probability as n — > oo. But the convergence does not 

yn log log n ^ u 

hold a.s. The law of the iterated logarithm says that limsup,^^ \ '„ = v2 
a.s. A functional version of the law of the iterated logarithm is called Strassen's 
invariance principle. 

It turns out that we also have a Strassen's invariance principle for nonlinear 
Hawkes processes under Assumption [TJ 

Theorem 2. Under Assumption^ let N be the stationary and ergodic nonlinear 
Hawkes process with dynamics (|1.2[) . Let X n :— N[n — l,ri] — fi, S n := N-i, 
s 2 := E[S' 2 ], g(t) = sup{n : s 2 < i} and for t G [0, 1], let rj n (t) be the usual linear 
interpolation, i.e. 
(1.11) 

„ (t) _ S k + ( S lt-s 2 )(s 2 +1 -s 2 )^X k ±1 s 2 <s 2 t<s 2 k _ Ql n _ 1 

y/2s 2 fog fog Si 

Then, g < oo, {r] n ,n > g(e)} is relatively compact in C[0, 1], the set of continuous 
functions on [0, 1] equipped with uniform topology and the set of limit points is 
the set of absolutely continuous functions /(•) on [0, 1] such that /(0) = and 

!lf{tfdt<i. 
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2. Proofs 



This section is devoted to the proof of Theorem [TJ We use a standard central 
limit theorem, i.e. Theorem [3] to prove our result. In our proof, we need to use 
the fact that E[iV[0, l] 2 ] < oo, which is proved in Lemma [2] Lemma [2] is proved 
by proving a stronger result first, i.e. Lemma U We will also prove Lemma [3] to 
guarantee that a > and the central limit theorem we obtained is not degenerate. 

Let us first quote two central limit theorems from Billingsley [7]. In both Theo- 
rem [3] and Theorem 31 the nitrations are natural nitrations, i.e. given a stochastic 
process (X n ) ne z, define := <j(X n ,a <n<b), where — oo < a < b < oo. 

Theorem 3 (Page 197 [7]). Suppose X n , n G Z. is an ergodic stationary sequence 
such that E[X n ] = and 



where \\Y\\ 2 = (ELF 2 ]) 1 / 2 . Let S n = X x + ■ • • +X n . Then S [n . } / ^/n~ -+ aB(-) weakly, 
where the weak convergence is on D[0,1] equipped with the Skorohod topology and 
a 2 = M[X§] + 2 5Z„ =1 E[XoX„] and the series converges absolutely. 

Theorem 4 (Page 196 [7]). Suppose X n , n eZ, is an erogdic stationary sequence of 
square integrable martingale differences, i.e. a 1 — E[X 2 ] < oo and K[X n \J-~^] = 0. 
Let S n = Xi + - ■ -+X n . Then S\ n .]/ ' \fn — > <jB{-) weakly, where the weak convergence 
is on D[0, 1] equipped with the Skorohod topology. 

Now, we are ready to prove our main result. 

Proof of Theorem^ Since in the stationary regime, E[iV[n, n + 1]] = E[AT[0, 1]] for 
any n £ Z and let us denote E[7V[0, 1]] = fi. In order to apply Theorem [3j let us 
first prove that 



Let E"i [N(n, n + 1}} and E"2 [N(n, n + 1]] be two independent copies of E[N(n, n + 
1] l-^o" 00 ] • ^ ^ s eas y ^0 check that 



(2.1) 




n>l 



(2.2) 




(2.3) 




-E [N(n, n + 1]] 2 J + -E E^ [N(n, n + l]] 2 

- E [e"i~ [N(n, n + 1]]E"=~ [N(n, n + 1]] 



E[E[N(n,n + l]\J^°°] 2 ] — 
E[(E[iY(n,n + l]- M |J- -°°]) 2 ] . 
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Therefore, we have 



(2.4) E[0E[JV(n,n + l] - 
1 



-E 



2 

< E 



2E 



E"i [N{n, n + 1]] - E 1 ^ [N(n, n + 1]] 

l 2 

E"i [JV(n, n + 1]] - E" [N(n, n + 1]] 
+ 



E"i [N(n, n + 1]] - E w [JV(n, n + 1]] 



E^ [7V(n, n + 1]] - E B [7V(n, n + 1]] 
0r 



where E [./V(n, n + 1]] denotes the expectation of the number of points in (n, n + 
1] for the Hawkes process with the same dynamics (|1.2|) with empty history, i.e. 
A(-oo,0]=0. 

Next, let us estimate E w i" [N(n, n+l]]- E [7V(n, n + 1]]. E u i [N(n, n + 1]] is 
the expectation of the number of points in (n, n + l] for the Hawkes process with 

intensity A t = A (j2 T . TeuJ - ULJ [o t) h(t — T )j ■ It is well defined for a.e. under P 
because under Assumption [T] 



(2.5) E[At] < A(0) + aE 



h(t - s)N(ds) 



A(0) +a||/i|| L iE[7V[0,l]] < oo, 



which implies that A t < oo P-a.s. 

It is clear that E^ 1 [N(n, n + l]} > E [A r (n, n + 1]] almost surely, so we can use 
coupling method to estimate the difference. We will follow the ideas in Bremaud 
and Massoulie 3] and use the Poisson embedding method. Consider (SI, J 7 , V), the 



canonical space of a point process on 



in which N is Poisson with intensity 



1 under the probability measure V . Then the Hawkes process 7V° with empty past 
history and intensity A° satisfies the following. 



(2.6) 



\n°(C) = J c N(dt x [0,A°]) C e B(R+). 



For n > 1, let us define recursively A™, D n and N n as the follows. 



A? = A 



(2.7) 



( /(cu) h (t ~ s)N n -\ds) + J2 tElj - h(t- r)) t 



D n (C) = J c N(dtx [\r\K 1 ]) 
N n (C) =N n - 1 {C)+D n {C) 



C e B(R+), 
C e B(R+). 



Following the arguments as in Bremaud and Massoulie [3], we know that each A™ 
is an J^-intensity of N n , where J 7 ^ is the a-algebra generated by N up to time t. 
By our Assumption [lj A(-) is increasing and thus it is clear that X n (t) and N n (C) 
increase in n for all t G M + and C E B(R + ). Thus, D n is well defined and also as 
n — > oo, the limiting processes At and N exist. N counts the number of points of 
N below the curve 1 1-> At and admits At as an J^-intensity. By the monotonicity 
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properties of A™ and N n , we have 



(2.8) 



(2.9) 



A? < A [ / h(t - s)N(ds) + V h(t - t) ) , 
At > A f / - s)iV n (ds) +- V &(i-T)| 



Letting n — >• oo (it is valid since we assume that A(-) is Lipschitz and thus continu- 
ous), we conclude that TV, At satisfies the dynamics (|1.2p . Therefore, with intensity 
At, N = N° + Yli^i is the Hawkes process with past history lu^ . 
We can then estimate the difference by noticing that 

oo 

(2.10) E w >~ [N(n, n + 1]] - E [iV(n,rt + 1]] =^E ? [A(n,n+l]]. 

i=l 

Here means the expectation with respect to the probability measure on the 
canonical space that we defined earlier. 
We have 

(2.11) E p [D 1 {n,n + 1]] 

rn+l 



= E 



E'' 



(X 1 (t)-X°(t))dt 



n+1 



A [ ^ h(i ■ 

\T<t,reJV°UWj _ 



A 1 ^ - r) ] di 

r<t,rS-/V°U0 



rn+l 

< a / ^ ft(t - r)di, 

«/ n _ 



where the first equality in (|2.11[) is due to the construction of D\ in (|2.7p . the 
second equality in (|2.11[) is due to the definitions of A 1 and A in (|2.7[) and finally 
the inequality in (|2.11[) is due to A(-) being a-Lipschitz by Assumption [TJ Similarly, 
we have 



(2.12) E p [D 2 (n,n + 1]] < E" 



a 



rn+1 

J TL r-, _ ^ 



TeD t ,T<t 

r-n+1 r t 



< V a 2 / h(t~ s)h(s - T)dsdt. 

Jn JO 



Iteratively, we have, for any fceN, 

rn+1 />tfc H2 

E p [£ fc (n,n + 1]] < V a fe / / •••/ /i(i fc - tk-i)h(t k -r - i fc _ 2 ) 



h(t 2 - tx)h(ti - r)dtx ■ ■ ■ dtk —■ K k (n,T). 
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Let K(n, t) := J^kLi K k (n, r). 



(2.13) E<^ E"i [N(n,n+ 1]] -E®[N(n,n+ 1]] 



<E E i^(n,i) J ftT(n,j)iV[i,i + l]7V[j,j + l] 

_i,j<0 

= E K(n,i)K(n,j)E[N[i,i+l]N\j,j + 1}} 

i,j<0 

< K(n,i)K(nJ)±{E[N[i,i+l] 2 }+E[N\j,j + l} 2 ]} 

i,j<0 



= E[iV[0,l] 2 ] ^K(n,i) 

\i<0 

Here, E[iV[0, l] 2 ] < oo by Lemma[51 Therefore, we have 

OO -j 

(2.14) { E [( E lN(n, n + 1}- m|^o"°°]) 2 ] } 

n=l 

oo 

< vmmo, i] 2 ] E E *( n >o 



1/2 



< v/2E[iY[0,l] 2 ]E a 



n— 1 i— — oo 
00 poo /-tt 

fc 



fc=l 



^0 JO J-oo 



h(t k - tk-i)h(tk-i - tjfe-2) • • ■ M*2 - h)h(ti - s)dsdti ■ ■ ■ dt k . 

Let H{t) := J* t °° h{s)ds. It is easy to check that f °° H(t)dt — th{t)dt < 00 by 
Assumption [T] We have 



(2.15) 



00 pt k pt 2 pQ 



>0 J v'O ./-oo 

h(tk - tk-x)h{tk-\ - ife-2) ■ ■ • h(t 2 - h)h(ti - s)dsdti ■■■dtk 

poo ft k ftl 

h(t k - t k -i)h{t k -i - tfc-2) • • • h(t 2 - ti)H(ti)dti ■ ■ ■ dt k 



Jo 

00 poo poo 



h(t k - tk-t)dt k h(t k -i - tfc_ 2 )dffe-i • • • H(tx)dt x 



Jt k - 2 Jt k - 1 

DC 



^II^IIlT 1 / ff(ti)dti = a te ||/i| 



fell nfe — x 
L 1 



th(t)dt. 
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Since a||/i||x,i < 1, we conclude that 
(2.16) jr {E [(E[N(n, n + 1] - //|^°°]) 2 ] }' 

n=l 

V ^/2¥ J [N[{),l] 2 ]a k \\h\\ k L - 1 1 f th{t)dt 

Jo 

th(t)dt < oo. 



< 



fe=i 



= v/2E[7V[0,l] 2 ]-- 

l-a||ft||ii 7 

Hence, by Theorem [31 we have 



(2.17) 
where 



crB(-) as t — > oo, 



(2.18) a 2 = E[(N[0, 1] - fi) 2 } + 2^E[(7V[0, 1] - /x)(iV[7, j + 1] - M )] < oo. 

i=i 

By Lemma |31 cr > 0. Now, finally, for any e > 0, for t sufficiently large, 

N [st] - n[et] N st - ust 



(2.19) 



sup 

0<s<l 



sup |(iV [st] — N s t) + A*(«* ~ [**])| >eVt) 

0<s<l / 

< P f sup |jV [rt] - JV st | + m > eVt ) 

\0<6<1 / 

<P( max N{k,k+1]> eVi- u) 
\o<fc<[t],fcez J 

< ([*] + l)P(iV[0, 1] >ev / i-^) 
+ 1 I" N[0, l} 2 dF -> 0, 



- M) 2 «/itf[0,l]>eVt 

as t — > oo by Lemma [2] Hence, we conclude that N ' t ^i^ t °~B(-) as t — > oo. □ 

The following Lemma Q] is used to prove Lemma [5] 
Lemma 1. There exists some 9 > sucft that sup t>o E left sh(t~ s )N(ds) 



< oo. 



Proof. Notice first that for any bounded deterministic function /(•), 
(2.20) exp j jf f(s)N{ds) - jf (e /(s) - l)A(s)da 
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is a martingale. Therefore, using the Lipschitz assumption of A(-), i.e. X(z) < 
A(0) + az and applying Holder's inequality, for ^ + ^ = 1, we have 



(2.21) 



70 



f*9h(t-s)N(ds) 



(•Jo 



= E W 
<E 
<E 
<E 



I ft / pOh(t-s) _ 



l) A ( s)ds+ l/ o *( e 



J , flf.(t- 8 )iV(<J S )-i/ '(e 



4 ft( e r<>H*-*)_ 1){m + a f°h(s-u)N(du))ds 



1 rt f P Bh(t-s)_ 



l)\(s)ds 



9 . e F/o x: ( e! " !Ms) - 1 ) A ( )' i;! 



Let C(i) = /J 2( e peft(t- s ) _ 1 ) ads> Therij we nav6j for any t g [ 0)T ] j 



(2.22) 



E w 



rt , , p eh(t_ 3 )_ 



l)ct Jg h(s~u)N(du)ds 



E 



< E 1 " 



a UTtT /o f (e p£,h(t - s) "l)aC(t) J S ^( S -«)/AT(d«)d S 



1 / 1( e p0Kt-s) _ l) ae c W/o Hs-u)N(du) ds 
C{t) Jo P 



< sup E w 

0<s<T 



= C(oo)/ s /i( s -u)Ar(d u ) 



where in the hrst inequality in (|2.22[) . we used the Jensen's inequality since i^e 1 
is convex and J ^■[e p0h ^ s ^ — \)ads — 1 and in the second inequality in (|2.22p . 

we used the fact that C(t) < C(oo) and again f* l{ e p6h ^-^ - l)ads = 1. Now 
choose q > 1 small so that ga||/i||x,i < 1. Once p and q are fixed, choose 8 > 
small enough such that 



(2.23) 



C(oo) 



lf e P0h(s) _ ^ ads < Q 
h P 

This implies that for any t £ [0, T], 



(2.24) 



/« 8h(t-s)N(ds) 



< sup I 

0<s<T 



e e / S h( s -u)N(du) 



q . e ?/o °(^ e ' ,W -l)A(0)d S _ 



Hence, we conclude that for any T > 0, 



(2.25) 



sup E 

0<t<T 



J /J h(t-s)N(ds) 



< e 



f™(e p6h( -"'>-l)\(0)d8 



< oo. 



□ 



Lemma 2. T/iere exists some 9>0 such thatE[e eN[Q - 1] ] < oo. Hence E[N[0, l] 2 ] < 



Proof. By Assumption^ h(-) > and h(-) is decreasing. Thus, 5 = inf te r 0)1 i h(t) > 
0. Hence, 

(2.26) EV*[*- M ] < E e [eUo K*-)^*)^ 
By Lemma [TJ we can choose 6* > small enough such that 

(2.27) limsupEV^ 1 '' 1 ] < oo. 

t— >oo 
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Finally, E[e 6N ^} < liminft-^ E [e 9 " 1 ' -1 '' 1 ] < oo. □ 

It is intuitively clear that a > 0. But still we need a proof. 
Lemma 3. a > 0, where a is defined in (|2.18|) . 

Proof. Let r) n = £°l„E[iV(j, j + ~ ^n+il where A 4 = Vll Vn is well 

denned because we proved (|2.2p . To see this, notice that 



(2.28) 



\Vn\\2 



J2®[N(j,j + l] 

j=n 

K> 

< £ \MN(j,j + 1] - Ml^vT+illla < oo, 



by (|2.2[) . Also, it is easy to check that 

(2.29) E[ Vn+1 - r, n + N{n, n + 1] - m|^T+i] 



E 



E 



£ E[iV(i,i + l]- M |j;-^] 



.?'=«•+ 1 



x—oo 
•'n+l 



£>[JV(j, j + 1] - m| J",;-] 



j=n 
00 



x — 00 
J ~n+1 



+ N(n,n+1] - [i 



= J2 E[iV(i,i + l]- M |J---]- ^ E[JV(i,i + l]- M |7---] 

j— n+1 1 

- AT(n, n + 1] + /i + N(n, n + 1] - fi = 0. 

Let = 77„_i — ?7n-2 + JV(n — 2, n — 1] — fx. Then, Y n is an ergodic and stationary 
sequence such that E[y„|J""^] = 0. By ((SJ), E[y„ 2 ] < 00 and by Theorem gl 
S'< n .J\/n — > o-'B(-), where S' n = Y?j=i Yj- ^ i s c l ear that a = a' < 00 since for any 
e > 0, 

(2.30) 



1 k \ 



< 



I max {rjk-i - V-i) > e V™ 

\l<fe<[n],fc£Z 

[{ max l»7fc-i| > ^rrH [J \\V-l\ > 



fe=i 



+ P I 1*7—3.1 > 



= ([n] + l)P(|»M| > 
4([n] + 1) 



< 



k-i|> £ # 



2 

l^dP-X), 



as n — > 00, where we used the stationarity of P, Chebychev's inequality and (|2.2|) . 
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Now, it becomes clear that 

(2.31) a 2 = (a') 2 = E[Y 2 } 

= E(r; -77_ 1 +iV(-l,0]- A1 ) 2 

(OO 
J2nm j + 1] - /ii^r°°] - 5>[iv(j, j + 1] - fA^n 
3=0 j=0 

Consider D = {lo : u~ ^ 0,w(O, 1] = 0}. Notice that P(w" = 0) = and by 
Jensen's inequality and Assumption [I] we have 

(2.32) ¥(D) = J (N(0, 1] = 0)F(du)-) 

> exp \ -E 



> exp < -A(0) - aE / V] ft(t - r)dt \ 



ret. 

> exp{-A(0) - aE[N[0, 1]] • \\h\\ L x} > 0. 
It is clear that given the event D, 

oo oo 

(2.33) X)E[JV0\ j + 1] - A^r°°] < E^O'.J + 1] - Ml-^o" 00 ]- 

j=0 3=0 

Therefore, 

(oo oo \ 

j2nN(jj + 1] - Mi-^r 00 ] ¥= E e w,j + 1] - > o, 
J=0 3=0 / 

which implies that cr > 0. □ 

Proof of Theorem^ By Heyde and Scott the Strassen's invariance principle 
holds if we have (|2.2|l and ct > 0. □ 
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